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Abstract. Let M„ denote the kth largest maximum of a sam- 
ple (Xi,X2, • • • , X n ) from parent X with continuous distribution. 
Assume there exist normalizing constants a n > 0, b n E M and a 
nondegenerate distribution G such that a~ 1 (M^ 1 ' ) — b n ) —> G. 
Then for fixed fcsN, the almost sure convergence of 

1 N 

, < a n x k + b n } 

n=k 

is derived if the positive weight sequence (d n ) with Dn = J2n=i dn 
satisfies conditions provided by Hormann. 
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1 Introduction 

Partial sum type almost sure (a.s.) central limit theorems were initiated 
by the papers of Brosamler (1988), Schatte (1988) and Lacey and Philipp 
(1990). For an i.i.d. sequence {X n ,n > 1} with mean 0, variance 1 and 
partial sum S n = ^22=1 -^fo the simplest version of the a.s. central limit 
theorem says 

N 



1 

E-I{S n < y/nx} — > $(x), a.s.Wx E 



logiV ^— i n 

n=l 



1 



where Ia denotes the indicator function and $(x) is the standard normal 
distribution function. For unbounded functional a.s. central limit theorems, 
Ibragimov and Lifshits (1998) and Berkes et al. (1998) obtained the follow- 
ing a.s. central limit theorem under different restrictions on the continuous 
function /: 

i N i f°° 
wlvE-/( 5 «/v^)- / fWdHx), a.s. 

1UgiV n =l J -°° 

The universal version of the a.s. central limit theorem discussed by Berkes 
and Csaki (2001) includes the case of the a.s. central limit theorem of ex- 
tremes of i.i.d random sequences which was first studied by Fahrner and 
Stadtmiiller (1998) and Cheng et al. (1998). Let {X n ,n > 1} be an i.i.d. 
sequence, and let M n = maxi<fc< n Xk denote the partial maximum. If there 
exist normalizing constants a n > 0, b n e K. and a nondegenerate distribution 
G(x) such that 



P {M n < a n x + b n ) -> G{x) (1.1) 



then 



1 N 1 

-Y-l{M n <a n x + b n }^G(x), a.s.WxeR. (1.2) 

log N ^— ' n 

n=l 

Fahrner (2000) extended (jl .21) to unbounded continuous functions. The gen- 
eral result is 



1 ^ 1 poo 



See Theorem 1 of Fahrner (2000). Stadtmiiller (2002) considered the a.s. 
central limit theorem of the kth maximum as k = k n satisfies logk n = 



(^((logn) 1 e ) for some e > or (n — k n )/n = p + 0(1/ \Jn\og £ n) for some 
< p < 1. Especially for fixed k he showed 



j- jh h{M™ < a n x + b n } -> G(x) ]T ( ~ lQg ,f {X)Y , a.s.Wxe 



log N ^— ' n 

to n=fc i=0 
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where denotes the kth maximum of Xt, X 2 ,---,X n and M n := M n l \ 
Peng and Qi (2003) proved the a.s. central limit theorem of central order 
statistics, see also Hormann (2005). 

In this paper, we consider the following averages: 

1 N 

— V d n l{M^ < a n x x + b n , M n 2) < a n x 2 + b n , ■ ■ - , < a n x k + b n } 

n=k 

provided the positive weights d n , n > 1 satisfy the following conditions: 

liminf nd n > 0, (1.3) 



n a d n is eventually nonincreasing for some < a < 1, (1-4) 

and 

lim sup nd n (log D n ) p / D n < oo (1.5) 

for some p > 0, where D n = Ylk=i dk- Under conditions fll.3p - fll.5l) it follows 
from the results in Hormann (2006, 2007a, 2007b) that 

1 N 

— d n l{S n < y^nx} $(x), a.s., 



and 



1 N 

a n x + b n } — > G(x), a.s. 



As discussed by Berkes and Csaki (2001) and Homann (2005, 2006, 2007a, 
2007b), the larger the D n , the stronger the almost sure central limit theorem 
(ASCLT). If d n <l/n such that D n -> oo, then the ASCLT holds. If d n = 1, 
there is no ASCLT on the partial sum and partial maxima. Conditions (jl.3|) . 
(11.41) and (11.51) tell us that there exists a large class of sequences 1/n < d n < 1 
such that the ASCLT holds. For example, we may assume D n — > oo with 
Karamata representation 

( re{u)\ 

D n = exp I / du I , n > a, 
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where 9(x) is a slowly varying function such that 

liminf 6{n)D n > 0, and limsup 6{n) (\ogD n ) p < oo 

for some p > 0, which guarantees that (11.31) . (jl.4p and (jl.5p hold. By the 
mean value theorem, we may choose d n ~ 8(n)D n /n. This implies that (d n ) 
is a regularly varying function with index —1. We mention the following 
examples: 

(a) D n = (logn) K with d n ~ K,(log n) K ~ 1 /n for k > 1, p > 0; 

(b) D„ = exp((log n) K ) with cZ n ~ Kexp((logn) K )(logn) K_1 /?T, for < k < 
1, < p < (1 - «;)/«; 

(c) _D n = (logn) 1_K exp((logn) K ) with d n ~ /texp((log n) K )/n for < k < 
1/2, < p < 1/k- 1. 

Throughout this paper we assume that F(x), the univariate marginal 
distribution of X n , n > 1 is continuous. This assumption implies that the 
order statistics are a.s. uniquely defined. Before providing the main results, 
recall the joint limit distribution of {^Mn\ Mn\ • • • ,M^J for fixed k if 
( 11.11) holds. Define levels u n (xj) = a n Xj + b n ,j = 1, 2, • • • , k, x\ > x 2 > 
■ ■ ■ > Xk and define the point process Xn of exceedances of levels u n (xj),j = 
1, 2, • ■ ■ , k by i.i.d random variables Xi, X 2 , • ■ ■ , X n . Then \n converges in 
distribution to a Poisson process on (0, 1] x R, for more details see Chapter 
5 of Leadbetter et al. (1983), which states the joint limit distribution of 

(M { n\M { n\--- and 

P {M® < a n x + b n )^G (x) ^ ( ~ l0g .f (3:)) ' =: H,(x), j = 1, 2, • • • , k 

(1.6) 

as n — > oo. The joint limit distribution of (m£\ M { n\ • ■ ■ , is so com- 

plicated that we express it as H{x\, x 2 , ■ • ■ , Xk) with the marginal distribution 
Hj(x) defined in (jl.6p . j — 1,2, ■ ■ ■ ,k, i.e. 

lim P (Mp < a n xi + &„, M^ 2) < a n x 2 + b 

n— >oo 

( H (xi, x 2 , ■ ■ ■ , x k ) , xi > x 2 > ■ ■ ■ > x k ; 
\ 0, otherwise. 
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2 Main Results 

In this section, we provide the main results. The proofs are deferred to 
the next section. 

Theorem 1. Suppose U.l\) holds for an i.i.d. random sequence (X n ,n > 1). 
Further assume U.3\) - I[1~d*\) hold for positive weights d n ,n > 1. Then for 
fixed fceN and real numbers x\ > x 2 > ■ ■ ■ > x k , we have 

1 N 

- V d n I{M« < M n (n), < Mn (i 2 ), ■-,¥«< « n (x,)} 

n=k 

-> H(xi,x 2 , ■ ■ ■ ,x k ), a.s., 
where u n (xj),j = 1, 2, • • • , k and H(x±, x 2 , • • • , Xk) are defined as before. 

Corollary 1. Under the conditions of Theorem^ for real numbers x kl > 
Xk 2 > ■ ■ ■ > %k t 1 < k± < k 2 < ■ ■ ■ < h < k, we have 



V d n I{M™ < u n (x kl ), MM < u n (x k2 ), • • • , < u n (x kl )} 

n=k t 

H {%k\ j -£fe2 ) ' ' ' ' ) j a.s., 



where H*(x kl ,x k2 , ■ ■ ■ ,x kl ) is the marginal distribution of H(x\,x 2 , ■ ■ ■ ,x k ) 
Especially, for fixed fceN, 



-L V d n I{M^ < u n (x)} -> H k {x) = G{x) V ( a . a . 

For bounded Lipschitz 1 functions, we have the following a.s. central 
limit theorem of order statistics. 

Corollary 2. Under the conditions of Theorem [7], for fixed k G N and 
bounded Lipschitz 1 function f , we have 



— V d n f (a- 1 (M<*> - b n )) - / f(x)dH k [a 



5 



3 Proofs 



As mentioned above, denote levels u n (x) = a n x+b n , x G M, n > 1 and real 
numbers x\ > X2 > ■ • ■ > Xk for fixed k. For convenience, let Mm,n denote 
the jth maxima of X m+ i, X m+2 , ■ ■ ■ , X n , < m < n and M„ : = M^\. Set 



W = I{M« n < u n ( Xl ), M$ n < u n (x 2 ), • • ■ , < u n (x fc )} 

-P (M« n < W „(x0, JUg, < u n (x 2 ), • • • , < Un (x fc )) 



for < m < n and f] n = r/o^. Before proving the main results, we need 
some lemmas. Our first lemma provides a bound on the expectation of the 
difference of the indicator functions for the jth maxima of the whole sequence 
and the jth maxima of the subsequence for j = 1, 2, • • • , k. 

Lemma 1. Assume U.l\) holds and m > k,n — m > k. Then 



uniformly for j — 1, 2, • • • , k and iGl. 

Proof. First note 1{M^ ] < u n {x)} - I{M$ n < u n (x)} ^ if and only if 
Mi j) > M$ n . The latter implies that M$ > Mm] n . It is known that the 
distribution of the general order statistic is 



E \I{M® < u n (x)} - 1{M% < u n (x)}\ < k 



m 



n 
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uniformly for 1 < j < k and x G M. □ 

Our next lemma provides a bound for the covariance of t] m and r] n , which 
will be used later for estimating the moment of the weighted sum of r] n . 

Lemma 2. Assume U.l\) holds. Then 

\Cov( VmjVn )\<2k 2 - (3.1) 
n 

for m > k,n — m > k. 

Proof. The desired result follows by Lemma Q] and noting 

Un{Xk)}\ 

+E |I{MM < u n (x k ^)} - I{M%-V < u n (x k ^)}\ 
+ ••• 

+ E |I{M« < u n { Xl )} - I{M« n < u n { Xl )}\) . □ 

The following lemma is useful to estimate the moment of the weighted 
sum of rj n - 7/ m , n . 

Lemma 3. Assume U.l\) holds. For m > k,n — m > k, we have 

E\r ]n -r ]m!n \<2k 2 -. (3.2) 
n 

Proof. Note 

E I Vn Vm,n \ 

(k k 
Hl{M$ n < u n ( Xj )} - l[l{M^ < u n { Xj )} 
3=1 j=l 
k 

by the elementary inequality \tj=i Vj ~ rij=i z j — Sj=i \Vi ~ z j\ f° r au 
\Uj\ < 1) l^jl < 1? j = 1,2, • • • ,/. By using Lemma [[J the proof is complete. 

□ 
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Lemma 4. Under the conditions of Theorem^ for any uo with k < m < 
uj < n and p £ N, 



E 



< 2 2p -'k (2 + kp^j (jSd; 



Proof. Note \r)i — r)k,i\ < 4 and, for m > k, I — m > k, by using Lemma [31 
we have 

E |t# - Vm,i\ P < 2 ■ 4 p - x E |t7, - 77^ < A p k 2 (y) . 

Then by Holder inequality and (11.41) . similar to the arguments in Lemma 3 
of Hormann (2006), we have 



E 



^ di (vi - Vm,i, 



By using the C r inequality, 

n 

^2di (vi-Vm,i) 



< 



4Pk?pi £/d? 



. l=0J 



E 



l=UJ 



< 2 P ^ E 



XI d 'fa 



E 



< 2 P_1 \2k-A p max rff + E 

u;<£<ix)+fc— 1 



X di (vi - Vm,i, 

l=w+k 
n ^ 

X di (m - Vm,i) 

l=uj-\-k 



< 2 2p ~ l k(2 + kp^ [Y^ld 2 

The proof is complete. □ 

The following is the result of Lemma [21 Lemma 4 and slight changes to 
the proof of Lemma 4 of Hormann (2006) (or Lemma 2 of Hormann (2007a)). 

Lemma 5. Under the conditions of TheoremUi for every p £ N, there exists 



a constant C v > such that 



E 



N 



n=k 



— I ^ ] d m d n ^— - 



\k<m<n<N 
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The following is the result of Hormann (2006, 2007a). 
Lemma 6. Assume U.5\) holds. For any a > and t] < p, we have 




Proof of Theorem [TJ, By Lemmas |4] and El using Markov inequality and 
the subsequence procedure, we obtain the desired results, cf. Hormann (2006, 
2007a, 2007b). □ 
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